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Abstract 

By using a simple interpolation argument, in previous work we 
have proven the existence of the thermodynamic limit, for mean field 
disordered models, including the Sherrington-Kirkpatrick model, and 
the Derrida p-spin model. Here we extend this argument in order 
to compare the limiting free energy with the expression given by the 
Parisi Ansatz, and including full spontaneous replica symmetry break- 
ing. Our main result is that the quenched average of the free energy 
is bounded from below by the value given in the Parisi Ansatz, uni- 
formly in the size of the system. Moreover, the difference between 
the two expressions is given in the form of a sum rule, extending our 
previous work on the comparison between the true free energy and its 
replica symmetric Sherrington-Kirkpatrick approximation. We give 
also a variational bound for the infinite volume limit of the ground 
state energy per site. 
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1 Introduction 



The main objective of this paper is to compare the free energy of the mean 



field spin glass model, introduced by Sherrington and Kirkpatrick in [16 



with the expression given in the frame of the Parisi Ansatz |14| , [12| , includ- 
ing the complete phenomenon of spontaneous replica symmetry breaking. 
In previous work ||, we have limited our comparison to the replica sym- 
metric case, by producing sum rules, where the difference between the true 
free energy, and its replica symmetric approximation, is expressed in terms 
of overlap fluctuations, with a well definite sign. As a result, the replica 
symmetric approximation turns out to be a rigorous lower bound for the 
quenched average of the free energy per site, uniformly in the size of the 
system. 

In the meantime, the old problem of proving the existence of the infinite 
volume limit for the thermodynamic quantities has been solved || , by using 
a simple comparison argument. 

Here, we extend this comparison argument, by introducing an appropriate 
generalized partition function, as a function of a parameter t, with < t < 1, 
able to interpolate between the true theory, at t — 1, and the broken replica 
Ansatz, at t — 0. Consequently, through a simple direct calculation, we can 
evaluate the difference between the true free energy, and its broken replica 
expression, still in the form of a sum rule, with the corrections, of a definite 
sign, expressed through overlap fluctuations, in properly chosen auxiliary 
states. As a result, the broken replica Ansatz turns out to be a rigorous 
lower bound for the quenched average of the free energy per site, uniformly 
in the size of the system. 

Moreover, the corrections, given in terms of overlap fluctuations, are in 
a form suitable for the exploration of the expected result of their vanishing, 
when the size of the system goes to infinite, along the program developed in 

Of course, our method does not use the replica trick in the zero replica 



limit, as explained for example in |T2[], nor the cavity method, as exploited 
for example in 0, pf, §, |7|. 



We give only a brief sketch of the extension of our method to the Derrida 



p-spin model @, 0, ||, ]T7]]. A more detailed treatment will be presented 
elsewhere |TD| . 

The organization of the paper is as follows. In Section 2, we will briefly 
recall the main features, and definitions, of the mean field spin glass model. 
In Section 3, the general structure of the Parisi spontaneously broken replica 
symmetry Ansatz will be described, in a form suitable for the developments 
of next Section. Section 4 contains the main results of the paper. Firstly, we 
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introduce the interpolating generalized partition function. Then, we evaluate 
its derivative, with respect to the interpolating parameter, arriving to the 
sum rule. The general broken replica bound follows easily. In Section 5, 
we give a variational estimate for the infinite volume limit of the ground 
state enrgy per site. Next Section 6 gives the essential ingredients of the 
extension of this method to the p-spin model. Finally, Section 7 is devoted 
to conclusions and outlook for further developments. 

2 The basic definitions for the mean field spin 
glass model 

The generic configuration of the mean field spin glass model is defined through 
Ising spin variables <7j = ±1, attached to each site % — 1, 2, . . . , N. 

The external quenched disorder is given by the N(N — l)/2 independent 
and identical distributed random variables Jy, defined for each couple of 
sites. For the sake of simplicity, we assume each to be a centered unit 
Gaussian with averages E(Jij) = 0, E(Jfj) = 1. 

The Hamiltonian of the model, in some external field of strength h, is 
given by the mean field expression 

H N (a, h, J) = — -== ^2 JijViVj - h^cTi. (1) 

^ N (ij) i 

Here, the first sum extends to all site couples, an the second to all sites. 

For a given inverse temperature f3, let us now introduce the disorder 
dependent partition function Zjv(/5, h, J), the quenched average of the free 
energy per site /jv(/3, h), the Boltzmann state uj, and the auxiliary function 
otv(/3, h), according to the well known definitions 

Z N ((3,h,J)= Yl eM-PH N (a,h,J)), (2) 

<ri...a N 

-PIn(P, h) = jV _1 £'logZjv(/3, h, J) = a N (P, h), (3) 
u J (A) = Z N ((3,h,J)- 1 J2 AeM~PH N (a,h,J)), (4) 

<Tl...(TJV 

where A is a generic function of the it's. 

Replicas are introduced by considering a generic number s of independent 
copies of the system, characterized by the Boltzmann variables <r l - 1 ' ) , crf\ . . ., 
distributed according to the product state Qj = uj^puo^P . . Here, all 
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ujj act on each one a\ s, and are subject to the same sample J of the 
external noise. 

The overlap between two replicas a, b is defined according to q a b = N^ 1 ^\ a^a^, 
with the obvious bounds — 1 < q^ < 1. 

For a generic smooth function F of the overlaps, we define the ( ) averages 

(F(q 12 ,q 13 ,...)) = EQj(F(q 12 ,q 13 ,...)), (5) 

where the Boltzmann averages Qj act on the replicated a variables, and E 
is the average with respect to the external noise J. 



3 The broken replica symmetry Ansatz 



While we refer to the original paper [14], and to the extensive review given 



in ||12|| , for the general motivations, and the derivation of the broken replica 
Ansatz, in the frame of the ingenious replica trick, here we limit ourselves 
to a synthetic description of its general structure, in a form suitable for the 
treatment of next Section, see also 0,0- 

First of all, let us introduce the convex space X of the functional order 
parameters x, as nondecreasing functions of the auxiliary variable q, both x 
and q taking values on the interval [0, 1], i.e. 

X3x: [0,1] 3q^x(q) € [0,1]. (6) 

Notice that we call x the nondecreasing function, and x(q) its values. We 
introduce a metric on X through the L l ([0,l],dq) norm, where dq is the 
Lebesgue measure. 

Usually, we will consider the case of piecewise constant functional order 
parameters, characterized by an integer K, and two sequences q , q±, . . . , qx, 
mi, ^2, • • • , Tn>K of numbers satisfying 

= qo < qi < . . . < qx-i < Qk — 1 5 < mi < m 2 < . . . < nix < 1, (7) 

such that 

x(q) = mi for = q < q < (Zi, x(q) = m 2 for qi < q < q 2 , 

x(q) = m K for q K _ x < q < q K . (8) 

In the following, we will find convenient to define also mo = 0, and nix+i = 1- 
The replica symmetric case corresponds to 

K = 2, qi = q, m x = 0, m 2 = 1. (9) 



4 



The case K = 3 is the first level of replica symmetry breaking, and so on. 

Let us now introduce the function /, with values f(q, y; x, /?), of the vari- 
ables q G [0, 1], y G R, depending also on the functional order parameter x, 
and on the inverse temperature (3, defined as the solution of the nonlinear 
antiparabolic equation 

(d q f)(q,y) + l -{f"{q,y) + x(q)f 2 (q,y)) = 0, (10) 
with final condition 

/(l,y)=togcosh(/fy). (11) 

Here, we have stressed only the dependence of / on q and y, and have put 
/' = d y f and f" = dlf. 

It is very simple to integrate Eq. (|10| ) when x is piecewise constant. In 
fact, consider x(q) = m a , for q a _i < q < q a , firstly with m a > 0. Then, it is 
immediately seen that the correct solution of Eq. (|T0|) in this interval, with 
the right final boundary condition at q = q a , is given by 

/(?, y) = — lo g / exp(m a /(g a , y + z^q a - q)) d/i(z), (12) 

where d/i(z) is the centered unit Gaussian measure on the real line. On the 
other hand, if m a = 0, then ( |I0"D loses the nonlinear part and the solution is 
given by 

/(?> V) = J f(<la, y + z^/q a - q) dfx(z), (13) 

which can be seen also as deriving from ( |T2"D in the limit m a 0. Starting 
from the last interval K, and using ([12]) iteratively on each interval, we easily 
get the solution of (|10D, fly]), in the case of piecewise order parameter 
in (|). 

We refer to 0] for a detailed discussion about the properties of the solution 
f(q,y;x, (3) of the antiparabolic equation fllQ|), with final condition (|TT]), as 
a functional of a generic given x, as in (§). Here we only state the following 

Theorem 1. The function f is monotone inx, in the sense thatx(q) < x(q), 
for all < q < 1, implies f(q,y;x,[3) < f(q,y;x,j3), for any < q < 1, 
y G R. Moreover f is pointwise continuous in the L 1 ([0,l],dq) norm. In 
fact, for generic x, x, we have 



\f(q,y,x,/3) 



f(q,V,x,P) \ < y j \x(q')-x(q')\dq'. 
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This result is very important. In fact, any functional order parameter 
can be approximated in the L l norm through a piecewise constant one. The 
pointwise continuity allows us to deal mostly with piecewise constant order 
parameters. 

Now we are ready for the following important definitions. 

Definition 1. The trial auxiliary function, associated to a given mean field 
spin glass system, as described in Section 2, depending on the functional 
order parameter x, is defined as 

a(l3,h]x) = log2 + f{0,h;x,P)-^ J qx{q)dq. (14) 

Notice that in this expression the function / appears evaluated at q — 0, 
and y = h, where h is the value of the external magnetic field. 

Definition 2. The Parisi spontaneously broken replica symmetry solution is 
defined by 

a((3, h) = inf a((3, h; x), (15) 

X 

where the infimum is taken with respect to all functional order parameters x. 

Of course, by taking the infimum only with respect to replica symmetric 
order parameters, as in @, we would get the replica symmetric solution of 
Sherrington and Kirkpatrick, as exploited for example in the sum rules in 
i,and§. 

The main motivation for the introduction of the quantities given by the 
definitions is the following expected tentative Theorem 

Theorem 2. (expected j In the thermodynamic limit, for the partition func- 
tion defined in (||) ; we have 

lim N^E log Z N (B, h, J) = a(B, h). 

N^oo 

Of course, the present technology is far from being able to give a complete 
rigorous proof. However, in the next Section we will prove that a(/3, h) is at 
least a rigorous upper bound for N~ Y E log Zn((3, h, J), uniformly in N. 

4 The main results 

The main results of this paper are summarized in the following 
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Theorem 3. For all values of the inverse temperature (3, and the external 
magnetic field h, and for any functional order parameter x, the following 
bound holds 

N- 1 E log Z N (f3,h, J) < a(P,h;x), 

uniformly in N, where a(f3, h; x) is defined in (\L$). Consequently, we have 
also 

N^E log Z N ({3, h, J) < a(0,h), 

uniformly in N, where a(/3, h) is defined in (WW. Moreover, for the thermo- 
dynamic limit, we have 

lim N~ l E log Z N ((3, h, J) = a((3,h) < a(/3,h), 

N^oo 



and 



lim N- 1 log Z N (P, h, J) = a((3, h) < a(f3, h), 

AT— >oo 



J -almost surely. 

The proof is long, and will be split in a series of intermediate results. 
Consider a generic piecewise constant functional order parameter x, as in 
(|8|), and define the auxiliary partition function Z, as follows 

Z N (fl,h;t;x;J) = exp j f3 ^ JijWj 

+i3h a + pvr^t via - qa-i J >A ^ 

i a=l i / 

Here, we have introduced additional independent centered unit Gaussian Jf , 
a = 1, . . . , K, i = 1, . . . , N. The interpolating parameter t runs in the 
interval [0, 1]. 

For a — 1, . . . , K, let us call E a the average with respect to all random 
variables Jf, % = 1, . . . , N. Analogously, we call E the average with respect 
to all Jij, and denote by E averages with respect to all J random variables. 

Now we define recursively the random variables Zq, Z\, . . . , Zk 

Zk = Zn(P, h; t; x; J), Z^^ = E K Z^ K , . . . , Z™ 1 = EiZ™ 1 , (17) 
and the auxiliary function dixit) 

a N {t) = ^E logZ . (18) 
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Notice that, due to the partial integrations, any Z a depends only on the J^, 
and on the J\ with b < a, while in at all J noises have been completely 
averaged out. 

The basic motivation for the introduction of a is given by 
Lemma 1. At the extreme values of the interpolating parameter t we have 

& N (1) = ^E\ogZ N ((3,h,J), (19) 
a N (0) = log2 + /(0,M,/3), (20) 

where f is as described in Section 3. 

The proof is simple. In fact, at t — 1, the Jf disappear, and Z reduces to 
Z in (H). On the other hand, at t — 0, the two site couplings Jy disappear, 
while all effects of the J" factorize with respect to the sites i. Therefore, 
we are essentially reduced to a one site problem, and it is immediate to see 
that the averages in ( |TT| ) reduce to the Gaussian averages necessary for the 
computation of the solution of the antiparabolic problem (|10"D, (|Tl|), as given 
by the repeated application of fll2[) , with the / function evaluated at q — 0, 
and y = h. 

It is clear that now we have to proceed to the calculation of the t derivative 
of Q!Ar(t). But we need some few additional definitions. Introduce the random 
variables f a , a — 1, . . . , K, 

Z ma 

fa = Ejzf^y (21) 

and notice that they depend only on the J\ with b < a, and are normalized, 
E(f a ) = 1- Moreover, we consider the ^-dependent state u> associated to 



the Boltzmannfaktor in (|T6|), and its replicated f2. A very important role is 
played by the following states u a , and their replicated ones fl a , a = 0, . . . , K, 
defined as 

cu K (.) = uj(.), w (.) = E a+1 . . . E K {f a+l . . . f K uj{.)). (22) 

Finally, we define the (.) a averages, through a generalization of @, 

(.} a = E(f l ...f a n a (.)). (23) 

As it will be clear in the following, the (.) a averages are able, in a sense, to 
concentrate the overlap fluctuations around the value q a . 

Now, we have all definitions in order to be able to state the following 
important results. 



8 



Theorem 4. The t derivative of a^it) in ( |7^ ) is given by 

K 



d 
~dt 



a N (t) 



[1 - ^2(m a+1 - m a )ql) 



a=0 



4 

—£ ^2( m a+i - m a )((q 12 - q a ) 2 ) a - 

a=Q 



(24) 



Theorem 5. For any functional order parameter, of the type given in (^), 
the following sum rule holds 



1 j3 2 f 1 

(P, h; x) = —E log Z N (p, h;J) + — ^(m a+ i - m a ) J ((q 12 - q a ) 2 ) a {t) dt. 

a=0 ^° 

(25) 



Clearly, Theorem |5| follows from the previous Theorem |], by integrating 
with respect to t, taking into account the boundary values in Lemma ^ and 
the definition of a(/3, h\ x) given in Section 3. Moreover, one should use also 
the obvious identity 

1 K f 1 

~(1 - VYm 0+ i - m a )ql) = / qx(q)dq. (26) 

By taking into account that all terms in the sum rule are nonnegative, 
since m a+ i > m a , we can immediately establish the validity of Theorem |^. 

Now we must attack Theorem The proof is straightforward, and in- 
volves integration by parts with respect to the external noises. We only 
sketch the main points. Let us begin with 

Lemma 2. The t derivative of a^it) in ( flffi ) is given by 

ja N (t) = ±E(fJ 2 . . . f K Z- l d t Z K ), (27) 

where 

Z K d t Z K = Z N l d t Z N 

Y J iM a i a i) ~ 9 /== Y - Qa-l Y J i U ^i)- 



2VtN^ J K J/ 2^T=t^ 

(ij) a=l 
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The proof is very simple. In fact, from the definitions in (|TTD, we have, 
for a = 0,1, ...,K-1, 

Z~ d t Z a = E a+ i(f a+1 Z~ +1 d t Z a+ x). (28) 

The rest follows from iteration of this formula, and simple calculations. 
Clearly, now we have to evaluate 

K 

E{Jijflh ■ ■ ■ fKU>(cri(Tj)) = ^E(... djyf a . . . ufatTj)) + E{f\ . . . fadj^wfaaj 

a=l 
K 

E(J?f l f 2 ...f K u(a i )) = J2 E (--- d ^fb---^))+ E (h---fKdj^(a i )), 

6=1 

where we have exploited standard integration by parts on the Gaussian J 
variables. 

The following lemma gives all additional information necessary for the 
proof of Theorem ^. 

Lemma 3. For the J -derivatives we have 

1 



dj^ia^) = /^-(l-^(a^)), (29) 

djauiai) = pVT^tVQa - q a -i(l - wVi)), (30) 

djyfa = pJ^mafa{&a(<7i<7j)-&a-l(<Ti<Tj)), (31) 

djfh = 0, ifb<a, (32) 



djffa = /Vl - Wq a - qar-lTnafa&afa), (33) 



dj-fb = /Vl - Wq a - q a -im h f h {Cu h {o-i) - w 6 _i(a , i )), ifb > a(34) 

The proof of ( ]2"5| ) and (^) is a standard calculation. On the other hand, 
Eq. ( pTD follows from the definition ([21]) and the easily established 

dj v Z?> = m a Z^Z- l d Ji3 Z a , 
Z^djyZa = E a+1 (f a+1 Z-^d. hj Z a+1 ), a = l,...,K-l, 

Z^Oj^Zk = ZjfdjyZn = pJ^wfaaj), 

Z^dj^Za = (3\p^E a+1 (f a+1 . . . f K u{a i a j )) = pJ^u a {aiaj). 

In the same way, we can establish (|32|), (p3|), (|34l). But here we have to 
take into account that Z b does not depend on J? if b < a. 
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A careful combination of all information given by Lemma ^ and Lemma 
H finally leads to the proof of Theorem |. On the other hand, the main 
Theorem |3| follows easily from Theorem [5], and the results of [[J . 



5 Broken replica symmetry bound for the ground 
state energy 

Let us consider the ground state energy density —ex (J, h) defined as 

- e N (J, h) ee i MH N (a, h,J) = - Jim (35 ) 
By taking the expectation values we also have 

e N (h) = E(e N (J, h)) = lim aN ^ h \ ( 36 ) 



From the results of the previous Section, we have, for any functional order 
parameter x, 

R/ln 7.„(R h J)) 

— < p- l ct{P,h;x), (37) 



/3 N 

uniformly in N. 

Let us now introduce an arbitrary sequence 

< mi < rfi2 < ■ ■ ■ < fflK, (38) 

and the corresponding order parameter x, defined as in but with all m a 
replaced by fn a . Notice that there is no upper bound equal to 1 for rfiK, 
and consequently for x. However, for sufficiently large (3, we definitely have 
iti>k < (3- Therefore, we can take in (37) the order parameter x defined by 
x(q) = x(q)/{3, with < x(q) < 1. Then we can easily establish the following 
Lemma. 



Lemma 4. In the limit (3 — > oo we have 



1 ^ 



lim (3 1 a((3, h; x) = a^ih; x) = /(0, h; x) — — / qx(q)dq, (39) 

where the function /, with values f(q, y; x) satisfies the antiparabolic 
equation 

{dj){q,y) + l(f"(q,y) + x(q)f'\q,y)) = 0, (40) 
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with final condition 

f(l,v) = \v\. (41) 
The proof is easy. In fact, the recursive solution for / coming from (|12|). 
allows to prove immediately 

lim p- 1 f(q,y;x/P) = f(q,y;x), (42) 

by taking into account the elementary lim^oo log cosh ((3y) = \y\. 
Therefore we have established 

Theorem 6. The following inequalities hold 

ejv(^) < ocN(h;x), (43) 
ejv(/i) < &N{h) = inf a.N{h\ x), (44) 

X 

lim eisf(h) = eo(h) < a^(h;x), (45) 
e (/i) < «iv(/i). (46) 

A detailed study of the numerical information coming from the variational 
bound of Theorem |] will be presented in a forthcoming paper |[T . 



6 Broken replica symmetry bounds in the p- 
spin model 

The methods developed in the previous Sections can be easily extended to 
the Derrida p-spin model @, 0, ||, ||I7| . We give here only a brief sketch. 



A more detailed treatment will be presented elsewhere |10 . 

Now the Hamiltonian contains a term coupling each group made of p 
spins 

H N (a,h,J) = -( 1 ^- I ) 1 i Jh...i P Pn---Vi v -h^<Ti. (47) 

(h,...i p ) i 

For the sake of simplicity, in the following we consider only the case of 
even p. Piecewise constant order parameters are introduced as in (0), (D), 
where now we assume qx = p/2. We still introduce the function /, defined 
by (pX|), with < q < p/2, and final condition 

/(p/2,3/) = logcosh(/fy). (48) 

We also introduce the change of variables q — > q, defined by 2q = pq 11 " 1 , so 
that, in particular, qjc < 1- The definitions ( |i~4"D and ( p!5]) must be modified 
as follows. 
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Definition 3. The trial auxiliary function, associated to a given p-spin mean 
field spin glass system, as described before, depending on the functional order 
parameter x, is defined as 

a(P, h; x) = \og2 + /(0, h;x, /?) - ^-Jj q{q) x(q) dq. (49) 



Definition 4. The spontaneously broken replica symmetry solution for the 
p-spin model is defined by 

a(P, h) = inf a(/3, h; x), (50) 

X 

where the infimum is taken with respect to all functional order parameters x. 

With the same procedure as described in Section 4, we arrive to the sum 
rule given by 

Theorem 7. In the p-spin model, for any functional order parameter, the 
following sum rule holds 

a(P,h;x) = ^ElogZ N {(3,h;J) 

+ -r 5j(m 0+ i - m a ) / {q[ 2 - pqnql' 1 + {p~ ^)q P a )a{t) dt 
4 a=o J o 

+ 0(1), (51) 

where a(/3, h; x) is defined in^^j. 

Notice that the terms under the sum are still positive. The O(-k) correc- 
tion is typical of the p-spin models. 
From the sum rule we have also 

Theorem 8. In the p-spin model, for any functional order parameter x , the 
following bound holds 

N- l E log Z N (P, h, J) < a((3, h; x) + O(^), 

where a(f3, h; x) is defined in Consequently, we have also 

N- X E log Z N {p, h, J)<a(j3,h) + 0{±), 
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where a((3, h) is defined in Moreover, for the thermodynamic limit, we 

have 

lim N~ X E log Z N ((3, h, J) = a((3,h) < a(@,h), 

N—*oo 

and 

lim N' 1 log Z N (P, h, J) = a{(3, h) < a((3, h), 

AT— >oo 

J -almost surely. 

We refer to [10 1 for a more detailed treatment. 



7 Conclusions and outlook for future devel- 
opments 

Without exploiting any reference to the zero replica trick, or to the cavity 
method, we have found a way to prove that the true free energy for the 
mean field spin glass model is bounded below by its spontaneously broken 
symmetry expression, given in the frame of the Parisi Ansatz. The method 
extends easily to the Derrida p-spin model. The key role is played by the 
auxiliary function a/v(£), defined in ([18]). Our method, in its very essence, is a 
generalization of the mechanical analogy introduced in ||, for the comparison 
with the replica symmetric approximation. 

The main open problems are given by the extension of these methods 
to other disordered systems, as for example the mean field neural network 
models. Moreover, the sum rules developed here could be taken as the start- 
ing point to prove that the additional positive terms do really vanish in the 
infinite volume limit. This would prove rigorously the validity of the broken 
replica Ansatz. 

We plan to report on these problems in future papers. 
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